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ABSTRACT 

The  tracking  signal  developed  by  Trigg  which  has  gained  wide 
acceptance  is  useful  for  monitoring  single  exponential  smoothing  fore¬ 
casts.  If  forecasts  become  biased, the  tracking  signal  will  increase 
in  absolute  value  indicating  the  possible  need  to  change  the  smoothing 
constant  which  is  the  one  adjustable  parameter  in  single  exponential 
smooth i ng . 

Two  methods  of  applying  the  tracking  signal  to  monitor 
exponential  smoothing  forecasts  are  discussed  in  this  document.  The 
method  which  was  applied  to  depot  workload  forecasts  is  described  in 
detail  and  the  tables  of  confidence  limits  which  are  necessary  to 
apply  this  method  are  given. 
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FOREWORD 


Single  exponential  smoothing  is  a  technique  used  for  determining 
a  forecast  based  on  historical  data.  Given  the  historical  data,  the 
forecast  is  uniquely  determined  on  the  basis  of  one  parameter  known  as 
the  smoothing  constant.  In  order  to  maintain  as  accurate  a  forecast  as 
possible  on  the  basis  of  this  technique  it  is  important  to  find  the  best 
value  for  the  smoothing  constant.  Since  the  historical  pattern  can 
change  with  time  or  because  there  is  not  sufficient  data  to  adequately 
develop  the  optimal  smoothing  constant,  this  constant  should  be  revised 
periodically.  The  tracking  signal  is  a  statistic  developed  by  D.  W. 

Trigg  (Reference  I)  which  indicates  when  a  change  in  the  smoothing 
constant  might  be  necessary. 

Confidence  limits  for  the  tracking  signal  were  determined  by 
M.  Batty  (Reference  2).  These  limits  are  useful  when  50  or  more  periods 
of  historical  data  are  available  for  the  computation  of  the  tracking 
signal.  However,  in  many  practical  situations  as  few  as  10  periods  of 
historical  data  are  available.  In  such  situations  the  distribution  of 
the  tracking  signal  is  significantly  different. 

The  objective  of  this  report  is  to  illustrate  how  the  tracking 
signal  can  be  used  to  monitor  exponential  smoothing  forecasts  and  to 
determine  confidence  limits  when  only  10  to  20  periods  of  data  are 
available.  One  who  applies  the  exponential  smoothing  procedure  to  his 
forecast  can  use  these  tables  to  decide  whether  to  revise  the  smoothing 
constant.  When  the  absolute  value  of  the  tracking  signal  exceeds  the 
confidence  limit  the  smoothing  constant  should  be  revised. 


I 


Trigg, 


D .  W . ;  Monitoring  a  Forecasting  System, 


(1964). 

2 

Batty,  M.;  Monitoring  an  Exponential  Smoothing 
Res  Q20,  No.  3,  319-325,  (1969). 


Op  I  Res  QI5,  271-274, 
Forecasting  System,  Op  I 
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METHODS  FOR  APPLYING  A  TRACKING  SIGNAL  TO 
MONITOR  SINGLE  EXPONENTIAL  SMOOTHING  FORECASTS 


I.  the  need  for  a  tracking  signal  in  exponential  smoothing  forecasts 

Single  exponential  smoothing  is  a  forecasting  technique  that 
is  useful  when  the  historical  data  have  no  trend.  In  this  case,  the 
data  are  assumed  to  be  relatively  constant  with  random  errors  causing 
fluctuations.  Based  on  the  historical  data  an  estimate  of  the  assumed 
constant  is  determined  and  used  for  the  next  forecast  period,  t.  When 
additional  data  become  available  the  estimate  is  revised  for  the  fore¬ 
cast  period  t  +  I . 

The  smoothing  constant  is  the  one  parameter  in  single 
exponential  smoothing  which  can  be  adjusted.  A  method  for  optimizing 
the  smoothing  constant  and  its  application  to  a  depot  supply  workload 
problem  is  given  in  Reference  3. 

Because  historical  patterns  change,  the  smoothing  constant 
that  works  best  during  a  given  period  may  not  continue  to  be  the  best 
in  the  future  and  thus,  it  may  be  necessary  to  revise  it.  Also,  in  some 
practical  problems  the  limited  amount  of  historical  data  available  is  not 
sufficient  to  adequately  determine  the  optimal  smoothing  constant.  In 
such  situations,  it  would  also  be  desirable  to  monitor  the  forecasts  to 
determine  when  to  revise  the  smoothing  constant. 

The  tracking  signal  provides  a  method  for  monitoring  the  fore¬ 
cast.  Two  applications  for  adjusting  the  forecast  by  use  of  the  track¬ 
ing  signal  are  presented  in  Section  3. 


2.  DEFINITION  AND  ELEMENTARY  PROPERTIES  OF  THE  TRACKING  SIGNAL 

the  smoothing  constant, 
data  for  period,  t, 

the  forecast  made  for  period,  t,  and 

'V 

S  -  S 

t-l  t 

represents  the  error  between  the  forecast  and  actual  for 

period,  t.  The  smoothing  forecast  for  period,  t  +  I  is  obtained  from 
the  following  formula: 


Let  A  = 


Chernick,  M.  R.;  Use  of  Exponential  Smoothing  to  Forecast  Depot  Supply 
Workloads.  SM&RSO  Interim  Note  No.  I,  (1971),  U.S.  Army  Materiel 
Systems  Analysis  Agency,  Aberdeen  Proving  Ground,  Maryland. 
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where  0  <  A  <  I  . 


S+  =  AS+  +  (I -A)  S+_I 

We  define  the  smoothed  error  recursively  as  follows 

%  % 

=  ae^.  +  (l-a)  e^._j  where  0  <  a  <  I  and  a  is  fixed. 

Let  |  e^.  |  denote  the  absolute  value  of  the  error  in  period,  t.  We  then 
define  the  smoothed  absolute  error  recursively  by  the  following: 

6.J.  =  a  |  |  +  ( I  -a )  6^.  j  . 

Let  T.J.  denote  the  tracking  signal  for  the  period,  t.  We  then 
define  the  tracking  signal  as 


% 


The  tracking  signal  has  the  following  properties: 

a.  —  I  <_  <_  I  for  every  t. 

b.  T^.  =  1  if  and  only  if  the  forecast  exceeds  the  actual  in 
each  of  the  previous  periods. 

c.  T.J.  -  -I  if  and  only  if  the  actual  exceeds  the  forecast  in 
each  of  the  previous  periods. 

Properties  b  and  c  suggest  that  as  the  tracking  signal 
approaches  unity,  the  forecasts  will  have  tended  to  consistently  exceed 
the  actual  and  that  as  the  tracking  signal  approaches  -I,  the  forecasts 
will  have  tended  to  be  consistently  below  the  actual.  This  is  equivalent 
to  saying  that  as  the  tracking  signal  approaches  I  in  absolute  value  the 
forecast  becomes  biased. 


3.  TECHNIQUES  FOR  IMPROVING  SMOOTHING  FORECASTS  BY  USE  OF  THE  TRACKING 
SIGNAL 

3. I  Adaptive  Smoothing. 

Adaptive  smoothing  is  a  technique  devised  by  Trigg  and  Leach 
(Reference  4)  to  enable  the  forecast  to  automatically  react  when  the 
tracking  signal  indicates  the  occurrence  of  biased  forecasts. 

4 

Trigg,  D.  W.,  and  Leach,  A.  G.;  Exponential  Smoothing  With  an  Adaptive 
Response  Rate,  Op  I  Res  Q 1 8 ,  No.  I,  53-59. 
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When  the  smoothing  constant  A  is  small  and  a  sudden  change 
(either  a  rapid  increase  or  decrease)  occurs  in  the  data,  one  obvious 
way  to  react  would  be  to  increase  the  smoothing  constant.  This  would 
enable  the  forecast  to  home  in  on  the  new  situation  more  quickly.  Once 
the  forecast  has  adjusted  to  the  new  situation,  it  may  be  desirable  to 
lower  the  smoothing  constant  again.  It  may  be  that  the  pattern  becomes 
stable  in  the  new  situation  and  if  this  is  the  case  the  high  smoothing 
constant  may  then  be. causing  too  much  reaction  to  the  random  noise. 

To  achieve  these  types  of  reaction  Trigg  and  Leach  thought  of 
a  very  simple  method;  namely,  to  set  the  smoothing  constant  equai  to 
the  absolute  value  of  the  tracking  signal.  This  method  is  called 
adaptive  smoothing.  This  means  that  the  smoothing  constant  wi I i  be 
continually  changing  from  forecast  to  forecast  according  to  the  way  the 
tracking  signal  is  changing.  As  the  absolute  value  of  the  tracking 
signal  approaches  unity,  the  smoothing  constant  increases  toward  one 
and  thus  the  forecast  reacts  more  quickly  to  the  change.  After  the 
reaction  takes  place  the  errors  should  return  to  being  unbiased  and 
hence  the  tracking  signal  should  decrease  in  absolute  value.  This  would 
then  produce  the  desired  decrease  in  the  smoothing  constant. 

A  modification  to  this  procedure  would  be  to  let  the  smoothing 
constant  be  equal  to  k  times  the  absolute  value  of  the  tracking  signal 
where  0  <  k  <_  I .  This  would  produce  the  same  effect  and  be  less 
restrictive.  Trigg's  method  would  correspond  to  k  =  I. 

The  adaptive  smoothing  technique  aiiows  for  an  automated 
response  to  changes  and  thus  would  be  desirable  and  easy  to  apply  when 
forecasts  are  handled  by  computer  for  a  iarge  number  of  items.  On  the 
other  hand  in  some  situations  it  may  be  better  for  the  individuals 
involved  in  preparing  the  forecast  to  be  made  more  aware  of  the  changes 
that  are  occurring.  The  tracking  signal  can  also  be  used  to  alert  the 
forecaster  of  changes  and  allow  him  to  decide  on  the  response.  One  such 
method  is  described  in  Section  3.2. 

3.2  Monitoring  Exponential  Smoothing  Forecasts  Using  Confidence 

Limits  for  the  Tracking  Signal. 

If  the  single  exponential  smoothing  forecast  is  behaving  well, 
the  error  between  the  forecast  and  actual  will  have  zero  mean  If  we 
assume  that  the  errors  are  normally  distributed  with  zero  mean,  we  can 
attempt  to  determine  the  distribution  of  the  tracking  signal.  This  will 
yield  confidence  limits  for  the  tracking  signal  which  can  then  be  used 
to  detect  when  a  change  in  the  smoothing  constant  is  necessary. 


4 

Ibid. 
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The  variance  of  the  smoothed  error  can  be  determined 
analytically  in  terms  of  the  variance  of  the  error  in  the  case  where  a 
is  set  equal  to  A  and  errors  are  not  serially  dependent.  Batty  shows 
that  in  this  case,  the  smoothed  error  is  then  normally  distributed  with 
mean  zero  and  variance 


2o2(A/  .3)  ,  (Reference  2). 

e  (2-A) 

If  we  then  had  the  distribution  of  the  smoothed  absolute  error 
we  would  still  have  the  problem  that  the  tracking  signal  is  the  ratio  of 
these  two  variables  which  are  serially  correlated.  It  is  therefore  an 
extremely  difficult  problem  to  analytically  derive  the  distribution  of 
the  tracking  signal  in  general.  However,  for  small  values  of  A  if 
observations  of  the  error  are  serially  independent  the  tracking  signal 
is  approximately  normally  distributed  with  zero  mean  and  variance: 

- Arc  ,  (Reference  2). 

2( 2-A; 


Batty  uses  this  distribution  to  determine  confidence  limits 
for  A  =  0.1  at  the  0.3,  0.2,  0.15,  0.10,  0.05,  0.04.  0.02  and  0.01 
significance  levels.  When  A  is  not  small,  the  assumptions  fail. 

For  larger  values  of  A  one  can  resort  to  Monte  Carlo  to 
generate  samples  for  the  data  with  the  appropriate  error  distribution. 
From  these  data,  sample  values  for  the  tracking  signal  can  be  generated 
and  confidence  limits  can  be  obtained  from  the  histograms.  Batty  did 
this  for  various  values  of  0£  and  found  that  the  tracking  signal 

variance  was  independent  of  the  error  variance.  He  also  found  for 
A  =  0. I ,  close  agreement  between  the  confidence  limits  obtained  from 
Monte  Carlo  and  those  gotten  by  assuming  a  constant  smoothed  absolute 
error.  He  found  that  the  distribution  of  the  tracking  signal  becomes 
bimodal  as  A  increases  and  this  is  very  noticeable  for  high  values  (i.e. 
0.4  or  0.5)  of  the  smoothing  constant. 

The  confidence  limits  obtained  by  Batty  include  A  =  0.1,  0.2, 
0.3,  0.4,  and  0.5.  He  did  not  however,  determine  the  limits  for  higher 
values  of  the  smoothing  constant  and  for  a  small  number  of  periods  of 
data  available.  Since  higher  values  of  the  smoothing  constant  were 
commonly  preferred  and  few  periods  of  data  were  available  in  an  applica¬ 
tion  of  exponential  smoothing  to  depot  supply  workload,  it  was  necessary 
to  determine  those  confidence  limits. 

Consequently,  a  sample  of  1,000  values  of  the  tracking  signal 
was  generated  for  various  values  of  N  (number  of  periods)  and  A.  These 
values  were  gotten  by  generating  values  for  the  error  in  each  of  the 


‘"'Batty,  M.;  Op.  C i t . ,  pp  322-323. 
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periods,  computing  the  smoothed  error  and  the  smoothed  absolute  error, 

and  getting  the  tracking  signal  as  the  quotient  of  these  two  quantities. 

The  sample  values  for  the  error  were  gotten  from  a  pseudo-random  number 

generator  for  a  normal  distribution  with  mean  zero  and  variance  i. 

The  distribution  of  the  tracking  signal  is  believed  to  be  independent 

of  the  error  variance  a  (Reference  2).  To  test  this,  a  value  of 

e 

=  101  was  used  and  it  gave  the  same  tracking  signal  histogram.  This 
agrees  with  Batty's  observation  for  large  N. 

From  the  1,000  values  of  the  tracking  signal,  the  point  below 
which  90  percent  of  the  values  of  the  absolute  value  of  the  tracking 
fell,  was  used  as  a  90  percent  confidence  limit  for  the  absolute  value 
of  the  tracking  signal. 

It  was  found  that  when  the  tracking  signal  was  based  on  only 
a  few  periods  of  data  its  distribution  appeared  to  be  much  different 
from  when  very  many  periods  of  data  were  used.  It  was  discovered  that 
for  50  to  100  periods  the  confidence  limits  were  in  close  agreement  with 
Batty's  for  A  =  0.1,  0.2,  0.3,  0.4,  and  0.5.  However,  when  the  number 
of  periods  was  less  than  20,  confidence  limits  were  significantly  higher. 

The  Appendix  gives  the  tables  for  the  confidence  limits  for 
various  values  of  N.  A  comparison  for  large  N  with  Batty's  confidence 
limits  are  also  given  in  the  Appendix. 

The  user  can  apply  these  tables  to  indicate  when  a  bias  exists 
in  an  exponential  smoothing  forecast.  He  must  compute  a  tracking  signal 
based  on  the  errors  he  has  experienced  in  the  past.  Given  the  value  of 
the  smoothing  constant,  for  example,  suppose  a  va I ue  of  A  =  0 .4  is  used, 
and  given  the  number  of  periods  of  past  data  used  to  compute  the  fore¬ 
cast,  say  13,  he  will  find  from  Table  2,  that  the  probability  that  the 
tracking  signal  will  exceed  0.72  In  absolute  value  is  only  0.1.  So,  if 
the  computed  value  is  greater  than  0.72,  he  may  wish  to  infer  that  the 
forecast  is  biased.  In  that  event,  he  may  decide  to  revise  the  smoothing 
constant.  One  way  to  do  this  would  be  to  recompute  an  optimal  smoothing 
constant  by  using  a  technique  such  as  the  one  mentioned  in  Reference  3. 


\oc.  Cit. 
^loc.  Cit. 
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APPENDIX 


90  PERCENT  CONFIDENCE  LIMITS 


A  comparison  of  90  percent  confidence  limits  computed  by  the 
author  for  large  N  versus  Batty's  confidence  limits.* 

TABLE  I  A  COMPARISON  OF  90  PERCENT  CONFIDENCE  LIMITS 


A 

Author's  Test 

Confidence  Limit  on 
the  Absolute  Value  of 
the  Tracking  Signal 

Ba++yTs  Test* 

Confidence  Limit  on 
the  Absolute  Value  of 
the  Tracki ng  S i gna 1 

0.  1 

0.36 

0.35 

0.2 

0.50 

0.50 

0.3 

0.61 

0.63 

0.4 

0.73 

0.72 

0.5 

0.80 

0.82 

# 

Differences  are  well  within  limits  of  variation  due  to  Monte 
Carlo  Samp  ling. 

^Batty,  M.;  Op.  Cit,,  p  324. 
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TABLE  2  90  PERCENT  CONFIDENCE  LIMITS  FOR  ABSOLUTE  VALUE  OF 

THE  TRACKING  SIGNAL  FOR  SMALL  VALUES  OF  N 
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